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Abstract 

While the notion of chaos is well established for dynamical systems on manifolds, 
it is not so for dynamical systems over discrete spaces with variables, as bi- 
nary neural networks and cellular automata. The main difficulty is the choice 
of a suitable topology to study the limit N ^ oo. By embedding the discrete 
phase space into a Cantor set we provided a natural setting to define topolog- 
ical entropy and Lyapunov exponents through the concept of error-profile. We 
made explicit calculations both numerical and analytic for well known discrete 
dynamical models. 
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1. Introduction 



For motions on differentiable manifolds, the commonly accepted notion of 
chaos identifies it with the so-called sensitive dependence on initial conditions 
and the latter with the existence of positive Lyapunov exponents signaling ex- 
ponential separation of initially close trajectories ^. In this sense, chaotic mo- 
tion means unstable behavior; there is, however, an equivalent interpretation of 
chaos in terms of information production ^. This is due to a celebrated theo- 
rem by Pesin which says that, for sufficiently regular ergodic systems, the sum of 
the positive Lyapunov exponents coincides with the Kolmogorov- Sinai dynamical 
(KS-) entropy associated with the dynamics. The KS-entropy measures the long 
run impredictability of the motion with respect to an invariant state. Further, a 
variational principle states that the maximal KS-entropy with respect to all pos- 
sible invariant states of a homeomorphism on a compact metric space is Bowen's 
topological entropy which gives a state-independent description of the degree of 
chaos based on how open sets change during the motion. 

Roughly speaking, in standard dynamical system contexts, chaos reveals 
itself through the exponential increase of errors or, equivalently, via not-less- 
than linear information production. 

On the contrary, there is no definite agreement about what chaos should 
mean in discrete dynamical systems, such as binary neural networks or cellular 
automata, where one cannot directly appeal to differentiability and thus to the 
standard definition of Lyapunov exponents. 

However, inspired by the equivalent manifestations of chaos, briefly sketched 
above, one may try to overcome the lack of differentiable structures by looking 
at entropy-like quantities. 

In the following, we shall investigate how far chaos in discrete system can 
be identified with the exponential increase of initial errors or with (topological) 
information production. 

Discrete, deterministic dynamical systems, consisting of binary variables, 
have finite, even though very large (2^), number of states . This means that 
their dynamics is eventually going to end up in a periodic cycle. Due to this fact, 
there is no room for chaotic behavior as it is usually intended, unless the number 
of states N ^ oo. 

In numerical studies of continuous systems one needs to discretize the man- 
ifold in order, to solve physical models based on differential equations Once 
the space has been discretized, the number of available states is finite and one 
has no longer a chaotic system since the motion eventually becomes periodic. 
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However the discretized systems inherit the natural distance of their continuous 
hmit, so that, if the number of states goes to infinity, one expects to smoothly 
retrieve the continuous structure with all its dynamical properties. The prob- 
lem with discrete dynamical systems is that the "natural" distance, the so-called 
Hamming distance is ill-defined in the limit N ^ oo ^. 

To overcome these difficulties; in this work we try to resort to topological 
techniques. On compact sets, one may define the concept of sensitive dependence 
on initial conditions (together with topological transitivity) by only topological 
means and no differentiable structure. So, we define the topology of a Cantor 
set and endow it with compatible metrics that remain well-defined in the limit 
of infinitely many states ^. Then we look at the various dynamical patterns that 
appear and try to characterize them by adapting standard tools from ergodic 
theory as, Lyapunov exponents and topological entropy I'H-i^ 

In Sec. 2, we review the concept of sensitive dependence on initial condi- 
tions formulated in a topological way. We endow the space with the topology of a 
Cantor set and introduce metrics compatible with it. In Sec. 3, Lyapunov expo- 
nents in discrete systems are defined by means of metrics and also in terms of the 
derivative of suitable embedding homeomorphisms into the reals. In Sec. 4, the 
topological entropy is formulated in terms of spanning sets; while in Sec. 5, Lya- 
punov exponents and topological entropy are related to an appropriate indicator 
of error propagation, that we call error-profile. In Sec. 6, some concrete calcula- 
tions are presented and in Sec. 7, conclusions are drawn and future directions of 
investigation briefly mentioned. 

2. Defining Chaos on Discrete Systems 



We shall study discrete systems described in the following way a phase 
space is defined by a set 0, of states S consisting of N bits Si = {0, 1}; i = 
1, . . . ,N, which evolve according to binary functions f : Q ^ Q, 



that update each bit Si{n) at each stroke of time n. 

In neural networks and cellular automata, in general, all bits have an equally 
important role in the development of the system with time. When the number 
N of bits is finite, the metric most suited to this state of affairs is the Hamming 
distance ^'^'^ given by 





N 




(2) 
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for any two states S, S' G Q. Note that Hamming distance counts the number of 
different bits between S and S', but it is not sensitive to where the differences 
occur. 

The usual way of identifying chaos in the evolution law (1) is to study the 
so-called damage spreading One follows the dynamical development of two 

states with initial Hamming distance equal to one and studies how it increases 
with time n. The speed of damage spreading is then defined by 

viS,S')= hm ^^(SH^S-(n)) 

n— >oo n 



Two observations are necessary at this point. The first is that the above 
definition does not correspond to the identification of an exponential increase 
of an initial small error, but only discriminates between sub-linear, linear and 
super-linear increase of the Hamming distance. 

The second is that, in the definition, it is implicit that the number of 
binary variables is infinite, otherwise there will be recurrences and the limit in 
(3) would automatically vanish. However, when N — > oo, the Hamming distance 
makes no sense since there are infinitely many states with infinite dn, and then 
it fails to be a properly defined distance function. 

Remark 2.1 We stress that if one wants to think of binary systems as dis- 
cretizations of continuous ones, so that asymptotic quantities like (3) make sense, 
then the metric of the space should be well defined when N ^ oo. There are 
two alternatives: either binary systems are taken as intrinsically discrete, in such 
a case formula (3) is to be investigated as a possible behavior over finite time- 
scales Or the number of states is allowed to go to infinity, in such a case, 
appropriate metrics that are well defined for A?" ^ oo have to be chosen in order 
to look at the dynamics from a topological point of view. 

In this paper we are going to explore the topological point of view. Let us 
take N ^ oo and introduce the base of open sets 

Af{S,q) =[S' en\ Sk = S'k, l<k<q] . (4) 

It is well known that they generate the topology of a Cantor set on 
Definition 2.1: A Cantor set is a topological space such that ^^: 

i) it is totally disconnected; 

ii) perfect, that is, it is closed and all its points are accumulation points; 
Hi) compact. 
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The main issue in what follows is the identification of chaotic behaviors 

in discrete systems with a Cantor structure. As observed in the introduction, 
the lack of differentiability excludes that one may recognize any exponential 
separation of trajectories from the analysis of the tangent map. 

Before trying to explore the possible existence of an exponential increase 
of initial small errors, one may start from a weaker form of instability than 
the usual one and identify a minimal degree of chaoticity with the following 
topological definition ^. 

Definition 2.2: Let / : O ^ O be a continuous map; we say that it shows weak 
sensitive dependence on initial conditions (w.s.d.i.c.) if there exists ap e IN such 
that for any S and any A/"(S, g), there exists a S' e A/'(S, q) and a A; e IN such that 

Remark 2.2 Note that the only requisite to define w.s.d.i.c is to have a 
topology on il. Which one? It depends not on mathematical arguments, but on 
physical considerations. That is, which properties do we want to measure and 
with how much accuracy? As extreme examples: in the trivial topology (given by 
{0, VL)) the dynamics is going to be trivial; while, in the discrete topology (where 
any subset of VL is an open set) all systems show w.s.d.i.c. 

There are several metrics compatible with the topology generated by the 
base (4), the more popular is ^^'^'^ 

oo ^ 

However, for the purpose of this work we are going to use, for any < /3 < 1, 
the following ones 

dp (S, S') = ii Sk = S'j^ yi<k<m and Sm S'^ , (5) 
in terms of which the base (4) can be expressed as 

N-{S,q) = [s' en \ dp{S,S')<p'^y (6) 

Remarks 2.3 

i) We can view the embedding process of a finite discrete system into the 
Cantor set as follows: Let be the set of all the continuous functions 
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f : Q ^ Q on the Cantor set. Then any finite discrete dynamical system 
with N bits described by equations (1) is an element of the set 



^AT = {/ e V S e O / (A/- (S, N)) ^M{f (S) , N)} . 

ii) There is a price to pay for working with the base (4) and their associated 
metrics (5). Indeed, some of the binary variables contribute more than 
others. At first sight, this looks as a major problem since typical binary 
systems such as the ones constructed with random couplings ^,18,19 evolve 
through functions /^'s where all the variables contribute on an equal footing 
to the dynamics and so, apparently, there is no reason to "dismiss" some 
and "privilege" others as the distances (5) do. However, if we make a 
permutation tt : INT — > INT of the automata's indexes, and thus re-enumerate 
them, the induced mapping tt : Q ^ Q, such that 

^{Sl, S2, • • •) = {St,-1(i), ■■ ■) , (7) 

is, as we show below, an homeomorphism and so the Cantor topology is 
preserved despite the fact that the new metrics are not going to be Lipschitz 
equivalent From this it follows that, since w.s.d.i.c. is a topological 
property, it does not depend in which way we have numerated the automata. 

Let us now show that tt is an homeomorphism: By construction the function 
is a bijection so we only need to show that it is continuous. Given £ > choose 
M e IN such that (3^ < e. Now take m e IN such that tt"^ (i) < m for any 
l<i<M. Then, 

dp (S, S') <(3^^dp (tt (S) , 7f (SO) <(3^ <e, 

hence continuity. 

Remarks 2.4 

i) The metrics (5) seem to establish a preferred direction along the network. 
However, one can always reverse it by means of the permutation 

TT ('S'l, S2, . . . , Sn) = {Sn, Sn-1, • • • , S2, Si) 

and, then, take the limit — >^ 00 in the metrics (5). 

ii) The metrics (5) are suited to semi-infinite networks. However, when ex- 
panding to infinity finite networks with periodic boundary conditions, as we 
will see in the examples, more symmetric metrics are preferable. These are 
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achieved by means of two-sided sequences S = (. . . 5'_2, ^o, Si, S2, ■ ■ ■) 
and using the metrics 

(S, S') = if Sk = S'k V|A;|<m 

with Sm ^ S'^ or S-m ^ S'_^ 

which also define a Cantor topology. 
3. Lyapunov Exponents 

Since Definition 2.2 is a topological one, and the metrics (5) all define the 
same topology, we can use any of them (by fixing a /?) to check if there is w.s.d.i.c. 
or not. 

However, in continuous dynamics there is a definition of sensitive depen- 
dence on initial conditions, which we shall refer to as strong (s.s.d.i.c) in compar- 
ison with the previous one (w.s.d.i.c), which is based on the concept of positive 
Lyapunov exponents; that is, on the exponential separation of initially close tra- 
jectories Such a behavior is usually associated with exponential increase 
of initial small errors. We propose two different natural definitions of Lyapunov 
exponents. The first one is based on the metrics (5), the second one is via an 
embedding of Q into the continuum; where the notion of derivative can be used. 

The metrics (5) offer a natural means to measure the increase of errors in 
Cantor sets. In fact, given dp, one can define Lyapunov exponents as follows: 

c?/3(r(s),r(s')) 

n^oo ap(o,0')^u ii (i^(S, S') 

The quantity Am(S) depends in general on S: it amounts to identify separation 
of trajectories with the following behavior 

Remarks 3.1 

i) In (8), we have used limsup as we do not know whether the limit for 
n — > 00 exist as it is the case for smooth dynamical systems by Oseledec's 
multiplicative theorem ^. Also, the limit when dp{S,S') — > may very 
well diverge as is the case when discrete dynamical systems exhibit nearly 
stochastic behavior such as random boolean networks or binary neural net- 
works with long range connections among the variables 8'9'i5,i8 



Am(S) = limsup lim —^ogg 
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a) Since the distances depend on we use a logarithm base P ^ to make 
Am(S) P independent. 

iii) Due to the presence of a positive Am because of the exponential separation 
of trajectories, however close to each other initially, it turns out that the 
s.s.d.i.c. property implies the weaker w.s.d.i.c. property. 

One may also try a kind of differential approach to the notion of exponential 
instability which is based on an appropriate embedding of the Cantor set Q into 
the reals (compare, the abstract mathematical approach in ^°). Let us consider 
the following commutative diagram 

4> i i 4> (9) 

which defines the function /, by means of a homeomorphism (p, with S being 
a Cantor set embedded in the reals (S C IR). It is important to observe that 
due to the commutativity of the diagram (9), the dynamics generated by / and 
/ are intrinsically the same because of topological conjugacy ^^'^^ Since Q is 
an uncountable compact Abelian topological group; there are uncountably many 
ways of constructing a homeomorphism (/> : O — > S (for instance, by suitable 
translations) We will consider a (f) that is suited to the metrics (5). Explicitly, 
let 

oo 

4>{S) = J2^kSk , (lOa) 

k=l 

where 

,, = .'(.-i-l) = (i^)'i±^, (106) 



with 

1 — a 

h = — - — and < cu < 1 , 
2 

sets the scale of the Cantor set by suppressing intervals in the proportion a (the 
standard choice being a = 1/3). Figure 1 explains the idea of the construction 
of the Cantor set in a graphical way. Note that the self-similar nature of the 
Cantor set is reflected by the fact that the coefficients 7^ satisfy the following 
recursion relation 

'Jk+m -ik ■ (11) 
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Now, given any continuous function / : Q 



Q, we define the function 




0o/(so-0o/(s) 
0(so-0(S) 



(12) 



which has the typical properties of a derivative. In particular it maps to the 
vector space IR. Indeed, (12) is nothing but the derivative of the conjugate map 
/. Of course the actual value of 5/i/(S) is ct-dependent, for if one wants to give 
the instantaneous rate of change of a function, one needs a scale! Similarly, if 
one wants to speak about the Hausdorff dimension of a Cantor set, one needs to 
embed it into IR and the result is going to be scale-dependent. 

From (12), there naturally comes the following proposal of Lyapunov ex- 
ponent associated with the derivative: 



4. Entropy 



In ergodic theory, one approaches the notion of entropy from two different 
perspectives: the first one is statistical and based on the presence of an invariant 
measure, the other is topological. We shall consider the latter point of view 
which leads to the notion of topological entropy i'i3,i4 



4.1 Topological Entropy 



In the topological case, the fundamental objects are the open sets (4). We 
shall calculate htopif) following standard techniques namely the so-called 
{n, e)— spanning set. For this we need the dynamics-dependent distances 



Ai,(S) = limsup-log;,-i|5^r(S)| . 



n— »oo IT' 



(13) 



0<A;<n \ / 



and the corresponding open balls 




(14) 
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A subset E {n, s) Cfl is called (n, £)-spanning if 

n= y Bf3{S,s,n). (15) 

S€E{n,e) 

That is, any (n, £)-spanning set corresponds to an open cover of O. Because of 
the compactness of Q, there will always be an (n, e)— spanning set containing 
finitely many states S; therefore, the minimal cardinality 

S(e,n) = min i^E(n,e) 

E(n,e) 

of (n, e)— spanning sets is finite. 

The topological entropy htop{f) is defined by 

htopif) = limlimsup-log5(£,n) , (16) 

^ n — >oo IT' 

where the logarithm is in base 2. 

Since the topological entropy htopif) reflects the way open sets change in 
time under / : f2 — > given by (1), htopif) will not depend on /?. This is Bowen's 
definition and is based on using metrics The intrinsically topological nature 
of the notion rests on the fact that Bowen's formulation is equivalent to the one 
of Adler, Konheim and Mc Andrew based on open covers i'^^'^^. 

Remark 4.1 

The topological entropy htopif) related by a variational principle to the 
metric or dynamical entropy of Kolmogorov, h^if): 

htopif) = sup h^if), (17) 

where A1(0, /) is the space of invariant measures in Q under the dynamics /. 
To establish (17) one needs a measurable structure to be defined on il, which 
is easily achieved by considering the cr-algebra generated by the open sets (4). 
What is more difficult to obtain is a measure ^ on the cr-algebra being invariant 
under the dynamics: fiif~^iC)) = /u(C) for all measurable subsets C C O. This 
is the meaning of the request /i G A1(n, /). Such a problem will be matter of 
further investigation and will not be of concern in this work. 
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5. Error-profile and chaotic behavior 

Now we are going to study how Lyapunov exponents (8), (13) and the 
topological entropy (16); are related to error propagation along the ordering 
defined by the metrics (5) over the network. 

Let us take two near states S and S' with initial distance 

d/3 (S, S') = . (18a) 
Their evolution in time can always be written as 

df3 (r (S), r (S')) = /?^-^"(S'S') , (186) 

where (S, S') G 2 measures the length traveled to the left (L„ > 0), or to the 
right {Ln < 0), by the errors at the n-th time step. The behavior of L„ (S, S'), 
numerically measurable, reflects the properties of the network dynamics and is 
not necessarily monotonically increasing with time. 

Remark 5.1 It is to be emphasized that (S, S') does not correspond to the 
Hamming distance, since g — L„ (S, S') locates the first error that appears in the 
automaton ordering associated with the metrics (5). Such an error may very well 
be the only one, in such a case: dn (/"(S), /"(S')) = 1. 

Thus, the picture we have in mind is as follows. Let us assume L„ > 0: 
at time n = 0, take two states S, S' which agree upon the first q — 1 bits, at 
time n = 1 they agree upon the first q — Li (S, S') — 1 bits, at time n = 2 upon 
the first q — L2 (S, S') — 1 bits, and so on. In this way, after n iterations of the 
dynamics (1), the first error will have propagated from position q to position 
g-l-L^(S,S'). 

Remark 5.2 If L„ < 0, then the initial error moves further and further away 
to the right with two consequences: first, it need not be the first error and thus 
need not appear at the exponent in (18b); second, it may become smaller and 
smaller contrary to the expectation that instability should amplify initial small 
errors. However, this is due to a preferred direction inherent in the choice of the 
metrics (5) as discussed in Remark 2.4.1 This also means that we can always 
consider > in (18b) up to a refiection: this argument particularly applies to 
the behavior of the rule 30 in Wolfram's classification (see the examples) which 
seems otherwise to contradict instability. 

Definition 5.1 We define the S- error-profile by the following limit, 

A^(S)= limsup L„(S,S') , (19) 

d0(S,S')^O 
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measures the length traveled by the errors at the n-th time step due to two 
infinitesimally closed initial states. 



Remark 5.3 The idea behind the previous definition is that, in physical in- 
stances, Ln (S, S') An (S) oncc spurious boundary effects are eliminated by 
S' — > S in the Cantor topology defined by the metrics (5). Numerically, the limit 
in (19), will be later handled by considering S and S' with df3{S,S') sufficiently 
small. 

We are now going to see how the error-profile is related with the concepts 
introduced in the previous sections. First, we deal with the Lyapunov exponents 
introduced in Sec. 3. 

5.1 Lyapunov Exponents 

Concerning metric-based Lyapunov exponents Am defined in (8), equations 
(18) and (19) yield 

Am(S) = limsup^^^ . (20) 

n— >oo Ti 

Concerning derivative-based Lyapunov exponents Ad defined in (13), we 
first calculate the derivative of a generic continuous function f : Q ^ Q. 

Consider two closed points S, S' G n with distance (3"^, they are of the form 
(see equation (5)): 

S = {S1S2S2 . . . Sm-lSmSm+l ■ • •) (21a) 

and 

S' = {S1S2S3 . . . Sm-iS'^S'^^i . . .) , (21&) 
where Sm 7^ S'^. Applying the homeomorphism (10a), we get 

00 

AS = (SO - (S) = 5] 7fe {S'k - Sk) . (21c) 

k=m 

The images of S and S' after the n-th time-step : 17 1-^ are; in a short hand 
notation, 

/" (S) = (C1C2C3 ■ ■ • Cp„-iCp„Cp„+i ■ ■ ■) 

and 

(S') = (C1C2C3 • • • Cp„-iCp„Cp„+i • • •) ' 
12 



where Cp„ 7^ Cp„ ; with = Pn ip^) being a function, of the initial error position 
m in (21). From (21c), we have that 

AS = 7m /im + Rm 

where iirn = S'^- Sm = ±1 and Rm = Zl^m+i 7fc /^fe- Now, by means of (10b) 
and (11) follows that | i?^ |< Efelm+i7fc = ^""^ So that i?^ ~ Oih"^) which 
gives 

AS = h"" {h-^ - 1) (1 + O (/i)) . 
An analogous expression is obtained for A/" = /"^ (S) — (S') giving 

Therefore, 

5^/" (S) = hm = hm /Xp„(m)/^^"^'"^-'" (1 + {h)) . 

If the limit exists; we obtain 

5,,r(s) = ±/i-^"(^) {i + o{h)), 

where 

An(S) = lim {m-pn{m)) , 

m— »oo 

which, if exists; it is the error propagation at time n as seen through the embed- 
ding (9). 

Inserting the above result into (13) yields 

Xd (S) = lim , (22) 

n— >oo n 

which, if it exists, equals (20). 

Remark 5.4 As observed in Remark S.l.n, the metric and derivative definitions 
of Lyapunov exponents do not depend on the specific scale used. The velocity of 
leftward propagation of errors should be a dynamical effect independent of the 
scale, which is exactly what turns out from above, whence the coincidence of (20) 
and (22). 
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5.2 Topological Entropy 



Consider equations (18) and let us define 

l:(S,S')= Lk{S,S') . (23) 

0<A;<n 

From (14) it follows that 

Bf3{S,e,n) = |s' G n I /^^-^"(s.s') < ^| . 

In the particular case where the dynamics (1) is such that L* is independent of 
S and S' let us define 

6^ ^ LI (S, S') (24) 
and take e = pp. Prom (6) and (14) it follows that 

= ^S' en \ (S, S') < I 

where 

rn,p = p + 9n + l . 
Since A/" (S, r^.p) are elements of the base (4), it follows that 

E{n,pP) = {sen\Sk = Oy k> rn,p} 

is an (n, /^p)— spanning set with cardinality 2^" ^; which, by construction, is min- 
imal. Prom (16) we obtain 



htopif) = lim limsup 



fn,p 



p^oo n^oo n 

So that, 

htopif) = limsup — . (25) 

n— >oo Tl 

In the general case (24) is not valid and the behavior of L* (S, S') depends 
on the fine details of the dynamics (1). In such cases, it is still possible to set an 
upper bound to the value of the topological entropy. Let us define 

r/(n)^maxL;(S,S'), 
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with S and S' subject to the constraint (18a). Then (using (6) and (14)), 



where 
Now 



D |s' e O I dp{S, S') < 

DJ\f{S,tn,p) , 

tn,p =p + r]{n) + 1 • 
E{n,|3P) = ^^Sen\Sk = 0y k> tn,p] , 



is again an (n, /5P)-spanning set with cardinahty 2*" ^, but we cannot assure that 
it is minimal. So, from (16) we obtain 

n( Til 

htopU) ^ hmsup , 

n— >oo Tl 

which assures that, if r]{n) does not increase as n or faster, the topological entropy 
vanishes. 

6. Examples 



6.1 The shift map 

We begin applying the ideas developed so far to the v-shift map Uy defined 

by 

ay {S1S2S3 . . .) = {Sl+yS2 + yS3+y . . .) . 

Consider two points S, S' e fl with distance dfj (S, S') = /?^. Applying we 
obtain 

d;3(S(n),S'(n)) . 
According to (18), (23) and (24), we see that On = vn; thus, from (25) we have 

htopif) =v>0 . 

It is also evident that the topological entropy coincides with the Lyapunov ex- 
ponents Am = A£) (see equations (20) and (22)). 



15 



6.2 Networks with three Inputs 



We study now the evolution rule (1) in the case of interactions involving 
three nearest neighbors and impose periodic boundary conditions; specifically 

Si{n+1) = f{Si-i{n),Si{n),Si+i{n)) for i = 2,3, . . . , N - 1 , (26a) 

5i (n + 1) = / {Sn (n) , ^1 (n) , ^2 (n)) , (266) 

and 

SN{n + l) = f (Sn-i (n) , Sn (n) , Si (n)) , (26c) 

where the transfer function / is the same for all the bits. 

Due to the periodic boundary conditions, the infinite limit of these net- 
work requires the symmetric metrics discussed in Remark 2.4. ii: this context 
accommodates errors propagating both to the left and to the right. 

We are going to study the boolean rules numbered 30, 73, 90 and 167 
according to Wolfram's scheme which we explicitly list in table 1. The first 
three columns give the values of three adjacent bits and the remaining columns 
show the corresponding bits for the two rules. We stress that the rule 90 is the 
XOR rule in the two adjacent bits and it is well known as "chaotic" in Wolfram's 
terminology. 

We have consider an automaton consisting of = 1000 bits and start with 
a random initial state. After a transient of length A^^ we let the dynamics reach 
a state S. Then we choose a state S' which differs from S in the 499, 500 and 
501-th bits, and start to measure the speed of error- profile ^ and the speed of 

damage spreadmg — — -. Ihe mam results are plotted m figures 2-4. 

Figures 2 show the spread of errors as the states S, S' evolve in time, each 
cross corresponding to a different bit in the two configurations. 

Figures 3 show the speed of error-profile as a function of time. According 
to (20) and (22), they exhibit, for n >> 1 a Lyapunov exponent A = 1 for all 
the rules but the rule 73 which shows A = 0. Same conclusions can be extracted 
from the topological entropy. 

Figures 4 show the evolution in time of the speed of damage spreading. 
One can see that no clear behavior emerges for n >> 1 that may help evaluate 
the damage spreading according to (3); moreover, even when, according to the 
Lyapunov and entropic analysis, the behavior is complex as is the case with rule 
90, there is instead a clear tendency of the damage spreading to go to zero. 
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It is important to observe from figure 2.b that rule 73 shows a complex 
behavior. However it is localized in the sense that it does not grow with N, so 
for oo, S and S' are on a periodic attractor and so the dynamics is not 

chaotic. In contrast the other rules, which are chaotic, spread the errors along 
all the bits. 



7. Conclusions 



We have endowed the phase space of binary variables with the topology 
of the Cantor set in the limit when the number of variables goes to infinity. 
This embedding of the phase space permits us to understand the dynamical 
behavior of binary dynamical systems, much on the same footing as the ones over 
differentiable manifolds providing a mathematically solid framework for discrete 
systems. One of the advantages of this approach, is the fact that the distance 
function (5) is well defined for finite or infinite A^. Despite being the Hamming 
distance (2), the most natural distance function over the space of binary variables 
Q, it has the disadvantage of being divergent as A?" — > oo on states differing on 
an infinite number of binary variables. 

We have formalized the notion of Lyapunov exponents for discrete systems 
in two related ways: by resorting to metrics compatible with the Cantor topology 
and by suitably embedding the Cantor structure into a differentiable one. 

Guided by the connections between Lyapunov exponents and topological 
entropy in continuous system, we have also computed the topological entropy 
and compared it with the Lyapunov exponents calculated according to the given 
prescriptions. This has been done in Sec. 5 where we related both notions to 
the concept of error-profile which is a phenomenological quantity that can be 
accessed numerically and has a self-evident physical interpretation. We have 
illustrated all these concepts by examples in Sec. 6. 

Further points that deserve to be studied are: 

i) The problem of the concept of a derivative. Here we have introduced it with 
the aid of the homeomorphism (10) which is compatible with the metrics (5). 
However, from the mathematical point of view it would be better if one could 
construct a meaningful "discrete derivative" which is homeomorphism free. 

ii) The construction of an invariant measure for the definition of the metric 
entropy (17), as sketched in Remark 4.1. 

Hi ) The application of the methods presented above to the treatment of Kauff- 
man's models of cellular automata with connectivity K and random couplings 
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which show a transition from an ordered phase for ii' < 2 where the length of 
the attractors grows as \/iV, to a disordered one, termed chaotic, for K > 2 with 
lengths growing as e^ 3,5, i8_ 
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Figure Captions 

Figure 1. Some steps in the construction of the Cantor set, with h = 



1 — a 
2 



Figure 2a. Spread of errors for rule 30. Starting from two states S, S' 
which differ in the 499, 500 and 501-th bits. A cross is plotted when the 
bits are different. Time goes from top to bottom for 100 iterations. 



Figure 2b. Spread of errors for rule 73. Starting from two states S, S' 
which differ in the 499, 500 and 501-th bits. A cross is plotted when the 
bits are different. Time goes from top to bottom for 100 iterations. 



Figure 2c. Spread of errors for rule 90. Starting from two states S, S' which 
differ in the 499, 500 and 501-th bits. A cross is plotted when the bits are 
different. Time goes from top to bottom for 100 iterations. 



Figure 2d. Spread of errors for rule 167. Starting from two states S, S' 
which differ in the 499, 500 and 501-th bits. A cross is plotted when the 
bits are different. Time goes from top to bottom for 100 iterations. 



Figure 3a. Evolution of the speed of error-profile ^ in function of time for 
rule 30 showing for n >> 1 a Lyapunov exponent A = 1. 



Figure 3b. Evolution of the speed of error-profile — in function of time for 
rule 73 showing for n >> 1 a Lyapunov exponent A = 0. 



Figure 3c. Evolution of the speed of error-profile in function of time for 
rule 90 showing for n >> 1 a Lyapunov exponent A = 1. 



Figure 3d. Evolution of the speed of error-profile — in function of time for 
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rule 167 showing for n >> 1 a Lyapunov exponent A = 1. 



Figure 4a. Evolution of the speed of damage spreading — ^ — ^ in 
function of time for rule 30. There is not a clear behavior for n » 1 which 
help to make an evaluation of the damage spreading. 



Figure 4b. Evolution of the speed of damage spreading — ^ — ^ in 
function of time for rule 73. There is not a clear behavior forn >> 1 which 
help to make an evaluation of the damage spreading. 



Figure 4c. Evolution of the speed of damage spreading — ^ — ^ in 
function of time for rule 90. There is not a clear behavior for n >> 1 which 
help to make an evaluation of the damage spreading and is tending to zero 
for a complex rule. 



Figure 4d. Evolution of the speed of damage spreading — ^ — ^ in 
function of time for rule 167. There is not a clear behavior for n >> 1 
which help to make an evaluation of the damage spreading and is tending 
to zero for a rule which has a positive Lyapunov exponent in our scheme. 
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Figure 2a. 
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Figure 2b. 
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Figure 2d. 
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